Papers with Natural language explanations
Cross-Refine: Improving Natural Language Explanation Generation by Learning in Tandem (2025.coling-main)
Copied to clipboard
| Challenge: | Natural language explanations (NLEs) are vital for elucidating the reasoning behind large language model (LLM) decisions. |
| Approach: | They propose a role-modeling approach that employs two LLMs as generator and critic to generate and refine NLEs. |
| Outcome: | The proposed model outperforms self-refine and can perform with less powerful LLMs. |
Verification and Refinement of Natural Language Explanations through LLM-Symbolic Theorem Proving (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for assessing the validity of explanations for NLI are time-consuming and prone to logical errors. |
| Approach: | They propose a framework that integrates Large Language Models and Theorem Provers to verify and refine natural language explanations through crowd-sourcing . they propose to use TPs to generate and formalise explanatory sentences and suggest potential inference strategies for NLI. |
| Outcome: | The proposed framework generates and formalises explanatory sentences and suggests potential inference strategies for NLI. |
FLamE: Few-shot Learning from Natural Language Explanations (2023.acl-long)
Copied to clipboard
| Challenge: | Recent work has shown limited utility of natural language explanations in improving classification. |
| Approach: | They propose a two-stage few-shot learning framework that generates explanations and fine-tunes a smaller model with generated explanations. |
| Outcome: | The proposed framework increases inference accuracy over strong baselines, but human evaluation reveals that the majority of generated explanations does not adequately justify classification decisions. |
Faithful and Robust LLM-Driven Theorem Proving for NLI Explanations (2025.acl-long)
Copied to clipboard
| Challenge: | Recent work has shown that the interaction of large language models (LLMs) with theorem provers (TPs) can help verify and improve the validity of NLI explanations. |
| Approach: | They propose to use logical expressions to guide LLMs in generating structured proof sketches and to use them to improve their accuracy. |
| Outcome: | The proposed strategies improve autoformalisation, syntactic errors and explanation refinement over the state-of-the-art model. |
Graph-Guided Textual Explanation Generation Framework (2025.emnlp-main)
Copied to clipboard
Shuzhou Yuan, Jingyi Sun, Ran Zhang, Michael Färber, Steffen Eger, Pepa Atanasova, Isabelle Augenstein
| Challenge: | Existing work has questioned their faithfulness, as they may not accurately reflect the model’s internal reasoning process regarding its predicted answer. |
| Approach: | They propose a Graph-Guided Textual Explanation Generation framework that generates a graph neural network layer that guides the NLE generation and generates explanations with greater semantic and lexical similarity to human-written ones. |
| Outcome: | The proposed framework improves NLE faithfulness by up to 12.12% compared to baseline methods on encoder-decoder and decoder-only models. |